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Abstract. This paper studies the problem of testing the null assumption of 
no-change in the mean of chronologically ordered independent observations on 
a random variable X versus the at most one change in the mean alternative 

£-- hypothesis. The approach taken is via a Darling-Erdos type self-normalized 

maximal deviation between sample means before and sample means after pos- 
sible times of a change in the expected values of the observations of a ran- 
dom sample. Asymptotically, the thus formulated maximal deviations are 

^C) ■ shown to have a standard Gumbel distribution under the null assumption of 

no change in the mean. A first such result is proved under the condition that 
EX 2 log log ( | .X" | + 1) < oo, while in the case of a second one, X is assumed to 

k>( ■ be in a specific class of the domain of attraction of the normal law, possibly 

$_i , with infinite variance. 
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1 Introduction and main results 

Let X, Xi,X2,--- be non-degenerate independent identically distributed (i.i.d.) real- 
valued random variables (r.v.'s) with a finite mean EX = fi. We are interested in testing 
the null assumption 

Hq : X\ , X2 , • • • X n is a random sample on X with a finite mean EX = (X 

versus the "at most one change in the mean" (AMOC) alternative hypothesis 

Ha '■ there is an integer k* , 1 < k* < n such that 
EX\ = • • • = EXk* / EXk* + i = • • • = EX n . 

The hypothesized time k* of at most one change in the mean is usually unknown. 
Hence, given chronologically ordered independent observables X\,X2, ■■■ ,X n ,n > 1, in 
order to test Hq versus Ha, from a non-parametric point of view it appears to be reasonable 
to compare the sample mean (X\ + • • • + Xk)/k =: Sk/k at any time 1 < k < n to the 
sample mean (Xk+i + • • • + X n )/(n — k) =: (S n — Sk)/(n — k) after time 1 < k < n via 
functionals in k of the family of the standardized statistics 
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1 < k < n. (1-1) 

(h.(i-k))l/2\ n l/2 nn 1 / 2 -' 

Vn v nil 

For instance, one would want to reject Hq in favor of Ha for large observed values of 

T„ := max |r„(fc)|. (1.2) 

l<fc<n 

On the other hand, when assuming for example that the independent observables 
X\, ■ ■ ■ ,X n ,n > 1, are N(fi,a 2 ) random variables, then we find ourselves modeling and 
testing for a parametric shift in the mean AMOC problem. It is, however, easy to check 
that, when the variance a 2 is known, then 

-2logA k = -^(T n (k)) 2 , (1.3) 

where A^ is the likelihood ratio statistic if the change in the mean occurs at k* = k. 
Hence, the maximally selected likelihood ratio statistic maxi<fc <n (— 2 log A&) will be large 
if and only if T n of (1.2) is large. A similar conclusion holds true if the variance a 2 is 
an unknown but constant nuisance parameter (cf. Gombay and Horvath (1994, 1996a, b), 
and Csorgo and Horvath (1997) [Section 1.4], and references therein). Namely in this case 
the maximally selected likelihood ratio statistic maxi<fc <n (— 2 log A&) will be large if and 
only if 

f fc := max — |r n (fc)| (1.4) 

l<fc<n CTfc n 



is large, where 
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l<i<fc k<i<n 



These conclusions, and further examples as well in Csorgo and Horvath (1988) [Sec- 
tion 2], and in Csorgo and Horvath (1997) [Section 1.4] that are based on Gombay and 
Horvath (1994, 1996a, b), show that under the null hypothesis H$ a large number of para- 
metric and nonparametric modeling of AMOC problems result in the same test statistic, 
namely that of (1.2), or its variant in (1.4). Consequently, if the underlying distribution 
is not known, the just mentioned test statistics should continue to work just as well when 
testing for H$ versus Ha as above. Furthermore, Brodsky and Darkhovsky (1993) argue 
quite convincingly in their Section 1.2 that detecting changes in the mean (mathematical 
expectation) of a random sequence constitutes one basic situation to which other changes 
in distribution can be conveniently reduced. Thus T n and T n gain a somewhat focal role 
in change-point analysis in general as well. Studying the asymptotic behavior of these 
statistics is clearly of interest. 

Let So = 0, and for n > 1 define the sequence of tied-down partial sums processes 

Zn(i ) := ( OV+i)*] - [(» + !)*] SnH/n 1 / 2 , 0<t<l, (L6) 

[ U, t = 1. 

In view of (1.1), we are interested in exploring the asymptotic behavior of the stan- 
dardized sequence of stochastic processes 



{«n^WJi z '' (t) - 0it<1 }' 



We first note that 



sup I|Z n (i)|/(t(l-t)) 1/2 
0<t<l cr 



and, naturally, also the standardized statistics r n and T n (cf. (1.2) and (1.4)) converge in 
distribution to oo as n — > oo even if the null assumption of no change in the mean is true. 
Hence, in order to secure nondegenerate limiting behavior under Hq, we seek appropriate 
renormalizations . 

For example, it is proved in Csorgo, Szyszkowicz and Wang (2004) (cf. Corollary 5.2 
in there) that, on assuming X to be in the domain of attraction of the normal law (DAN), 
possibly with infinite variance, then, as n — > oo, 

sup — i \Z n (t)\/q(t) A sup \B(t)\/q(t), (1.7) 

0<«1 0[nt+l],n 0<t<l 

where {B(t),0 < t < 1} is a Brownian bridge, o^, 1 < k < n — 1 is as in (1.5), 
a n,n := n l^l<i<n\^i J?) > 

f (tiogiogCr 1 )) 1 /*, te (0,1/2], 

q{h 1 ((i-i)loglog((i-t)" 1 )) 1 /2, te [1/2,1), 



and logs := log(max{e,x}). 

Large values of the statistics in (1.7) indicate evidence against Hq. The weight function 
q{-) is to emphasize changes that may have recurred near and n. We note in passing that 
the result in (1.7) cannot be deduced via first proving a "corresponding" weak invariance 
principle on D[0, 1] (cf. Csorgo et al. (2004), Remark 5.2, as well as Corollaries 2 and 4 
of Csorgo et al. (2008a) and their extension (46) in Theorem 4 of Csorgo et al. (2008b)). 
The applicability of (1.7) is much enhanced by Orasch and Pouliot (2004), tabulating 
functionals in weighted sup-norm. 

An alternative way of studying change in the mean is via Darling-Erdos type theorems. 
For example (cf. Theorems 2.1.2, A. 4. 2 and Corollary 2.1.2 in Csorgo and Horvath (1997)), 
under Hq with EX 2 loglog(|A| + 1) < oo, we have 

lim P(a(n) max - — ( — - — ) Z n ( ) <t + b(n)) = exp(-e _t ), t € R, (1.8) 

n->oo \ l<k<n (Jk,n \k\Jl — K) / Vn + 1/ / 

where 

a(n) := (21oglogn) ' and b(n) := 21oglogn + - logloglogn — - log7r. (1-9) 

In view of (1.7), the aim of this paper is to explore the possibility of extending the 
result of (1.8) to versions of Z n {^j-^) under Hq with X £ DAN, for the sake of having 
an alternative approach to the sup- norm procedure of (1.7) for studying the problem of a 
change in the mean in DAN, possibly with EX 2 = oo. 

Define the family of statistics 

Ji~jfc 

2. (1.10) 





Jk &n~&k 




J- k,n - 


k n—k 
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We note 


in passing that, on writing 
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z2l<i<k [Xt k j z2k<i<n [X* n-k ) 

fe(Jfc-l) (n-k){n-k-l) 


, 2<k<n 


we get 






Tk,n 


1 / n \ 1/2 / n 2 \ i/ 2 / k \ 


2<k<n- 


&k,n^k(n — k)J \k(n — k)J \n + l/' 



;i.n) 



(1.12) 

We note also that {k(n — k)jn)a\ n is an unbiased estimator of a 2 when EX 2 < oo. 

Our first result is to say that, under the same moment condition for X, the self- 
normalized statistics max 2 <fc<„_ 2 T k ^ n behaves like maxi< fc<n g^( fc (^_ fc) ) 1/2 ^n(^i) does 
asymptotically (cf. our Theorem 1.1 and (1.8)). Our main result, Theorem 1.2, however 
concludes the same asymptotic behavior for maxi<fc <n Tf. tU for X £ DAN with possibly 
infinite variance. 



Theorem 1.1. Assume that Hq holds and 

EX 2 \og\og{\X\ + l) <oo. (1.13) 

Then 



lim P (a(n) max T kn <t + b(n)) = exp(-e ), tel. 

n->oo V 2<fc<n-2 ' / 

Write l(x) := E{X — [i) 2 I(\X — fi\ < x). Assume that X belongs to the domain 
of attraction of the normal law. Then l{x) is a slowly varying function as i — > oo. 
Consequently, there exists some a > 1 such that for any x > a (see, for example, Galambos 
and Seneta (1973)), 



l(x) 



exp{c(x) + [ X ^-dt}, (1.14) 



where c(x) — > c(\c\ < oo) as x — > oo and e(t) — > as t — > oo. 

Theorem 1.2. Assume that Hq holds and l(x) is a slowly varying function at oo that, 
in terms of the representation (1.14), satisfies the additional conditions c(x) = c and 
e{t) < Co/ log t for some Cq > 0, i.e., X e DAN, possibly with infinite variance, under 
the latter specific conditions on l(x). Then, for all t £ R, 

lim P[a(n) max T^ n < t + bin) ) = exp(— e _i ). 

n^oo \ 2<k<n-2 ' / 

Remark 1. The additional conditions in Theorem 1.2 are satisfied by a large class of 
slowly varying functions, such as l{x) = (loglogrr) a and l(x) = (logx) a , for example, for 
some < a < 00. 

Remark 2. Csorgo, Szyszkowicz and Wang (2003) obtained the follwoing Darling- 
Erdos theorem for self-normalized sums: suppose that Hq holds with EX = and l{x) is 
a slowly varying function at 00, satisfying 

l(x 2 ) < Cl(x) for some C > 0. (1.15) 

Then, for every t € R, 

lim P[a(n) max Sk/Vk <t + b(n)) = exp(— e _i ). 

n— >oo V \<k<n J 

If l(x) has the representation (1.14) with c(x) = c and e(t) < Co/ log t for some Co > 0, 
then 

■2 



l(x 2 ) _ ( f x s(t) 

W) 



exp{£^}<exp{Co£^}=2-o. 



So, (1.15) holds under the additional smoothness conditions for l(x) that are needed for 
results like Lemma 2.1, for example. On the other hand, if e(x) = (logx)~ a for some 



< a < 1, then lim l(x 2 )/l(x) = oo, i.e., (1.15) fails. Thus, the additional conditions on 

x— >oo 

l{x) in Theorem 1.2 that are sufficient for having (1.15), are seen to be not far from being 
also necessary. 

Before proving Theorems 1.1 and 1.2, we pose the following question. 

Question 1. In view of Theorems 1.1 and 1.2, one may like to know if the result of 
(1.8) could also hold true when replacing condition (1.13) by X € DAN, possibly with 
EX 2 = oo. 

Question 2. In view of having Theorems 1.1 and 1.2, one would hope to have (1.7) in 
terms of T M , i.e., when replacing ^-^- by _-I— ( Fm ^- p]) )V2 on the left hand side 

of (1.7), with a k:n , 1 < k < n - 1 defined as in (1.11) and ct 2 „ := 4j J2i<i< n ( X i ~ if) 2 - 

As to these questions, it is clear from the respective proofs of (1.8) (cf. Corollary 
2.1.2 in Csorgo and Horvath (1997)) and Theorem 1.1 that, under the condition (1.13), 
the two estimators o\ n and (k(n — k)jn)o\ n of a 2 are asymptotically equivalent. When 
Var(A) = oo, this does not appear to be true any more, i.e., when these "estimators" in 
hand are being used as self-normalizers. However, we could not resolve this problem as 
posed in the context of these two questions. 

2 Proofs of Theorems 1.1 and 1.2 

Without loss of generality, in this section we assume that \i = 0. 

Proof of Theorem 1.1. Write K n = expjlog 1 ' 3 n}. With o\ n as in (1.11), in view of 
(1.12), at first, we prove that, as n — > oo, 



max 

K n <k<n~K n 



k[n k) _ 2 2 



n 



o P ((loglogn)" 1 ). (2.1) 



Write b n = n/ log log n. Then b n /n \, and b 2 n Y^L n ^i = 0(n). Noting that, for sufficiently 
large n, we have 

p(\X 2 -a 2 \>b n ^j < p(|X 2 -ci 2 |loglog(|X 2 - C j 2 | + l)>6 n loglog6 n 

< P(\X 2 - a 2 \ loglog(|X 2 - a 2 \ + 1) > (l/2)n 

and .E|X 2 -0- 2 |loglog(|X 2 -cr 2 | + l) < oo (by the assumption E'X 2 loglog(|X| + 1) < oo) 
we conclude 

oo 

f]p(\X 2 -a 2 \>-^—)<oo. 
L — ' V log log n / 

n=l 

By Theorem 3 in Chow and Teicher (1978, page 126), we get 

k 

2_){X? — a 2 ) = o(k(\og\ogk)~ l ) a.s. as k — > oo. 
*=1 



Hence, by the classical Hartman-Wintner LIL, as k — > oo, we have 

k k 

]T(X; - Sk/kf - ka 2 = Y,(X? ~ ka 2 ) - S 2 /k = o(A;(loglog k)' 1 ) a.s. 



i=\ 



i=\ 



Consequently, 



ll k 
max - VV-Xj - S k /k) 2 - a 2 = o P ((loglogn) x ), 



K n <k<n I k 



t=l 



and 



max 

l<k<n-K n 



1 n 

— Y J {X l -{S n -S k )/(n-k)) 2 -a 2 =op((loglogn)- 1 



n — k 



i=k+l 



Hence (2.1) holds. 

By Theorem 2.1.2 in Csorgo and Horvath (1997), we have 



(2 log log n) ' max 



n \i/2 



V 



i<fe<n \k(n — k)J 
This, together with (2.1), implies 

1 



k 

n 



a. 



a{n) 



max Tj. n max 

K n <k<n-K„ a K„<k<n-K n \k(n — k) 



n \i/2/ ft 



< a(n) max 



??■ 



K n <k<n-K n \k(n — k) 
op (1) (log log n) _ ' max 



1/2 



n 
n \i/2 



fc(n-fc)„ 2 \-V 



cr 



i<fc<n \£;(n — k) 



n 

Sk — S n 
n 



a 



0. 



Then from the proof of Theorem A. 4. 2. in Csorgo and Horvath (1997), for all t E R, it 
follows that 

(2.2) 



lim PI a(n) max T kn < t + b(n) I = exp(— e 

n— >oo V K„<k<n-K„ ' J 

Similarly to the proof of (2.26) and (2.27) below, we get 



and 



a(n) max Tu „ — bin) — > — oo, 



a(n) max T^ jTl — b(n) — > — oo. 

n— K n <k<n— 2 



(2.3) 



(2.4) 



Now Theorem 1.1 follows from (2.2)-(2.4). □ 

We continue with establishing three auxiliary lemmas for the proof of Theorem 1.2. 



As in Csorgo et al. (2003), we start with putting b = inf{x > 1; l{x) > 0} and 

l ( s ) / (log log n) 4 ■ 



r/ n = inf{s:s>6 + l,-^< 



/? 



1 



Let 



Z j = X j I(\X j \>r h ), Y j =X j I(\X j \<r, j ), Y* = Yj-EYj, 



s n = ^Y*, bI = Y,ey; 2 , v^J^xf. 

i=i i=i i=i 

Then, as n — > oo, rj n — > oo, nl(rj n ) = r/^ (log log n) 4 for every large enough n and 2?^ ~ 
nl(i] n ). As in Csorgo et al. (2003), we may assume without loss of generality that 

B n = nl(r) n ) = 7? n (loglogn) for all n > 1. 

Let {A, Ai, A 2 , • • • } be a sequence of i.i.d. random variables with A = X, in- 
dependently of {X, Ai, A 2 , • • • }. We define S n , Zj, Yj, Y* , 5* and V^ similarly to 
5 n , Zj, Yj, Y* , 5* and V n . Define 



&k,n 



s 



k,n 



B 



k,n 



v k,n 



V, 



k,n 



S k _ S n -[ n /2\+S[ n /2\—Sk 

k n—k ' 

S[n/2]+S n ~[n/2}-Sn-k _ S n _fc 

k n—k ' 

S% _ S n-[n/2\ +S [n/2\- S k 

k n—k ' 

J [n/2r J n _[ n / 2 ] D n-fc _ ^n-fc 

fc n— fc ' 

B l , B n-[n/2]+ B Pn/2]~ B fc 

"P" " l (n-fc) 2 

2 _i_r2 _ R 2 



B [n/2] +B n-[n/2] ^n-fc 



T 5 " 



+ 



S n-fc 



(n-k) 



7- 



if 1 < fc < n/2; 
if n/2 < k < n, 

if 1 < k < n/2; 
if n/2 < k < n, 

iil<k< n/2; 

if n/2 < k < n, 



V k _ S k _|_ ^n-[»i/2] + ^[n/2] ^fc _ (gn-[n/2] +5[ n /2] ~gfc )' 



7^ 



+ 



(n-k)' 1 



(n-ky 



, if 1 < k < n/2; 



V [n/2] +V n-[n/2] V n-k (S[n/2] +S n - [ n /2] ~S n - k ) 2 V„-k 



-w 



~w 



+ 



a2 

a n-k 



(n-k) 2 (n-k) 3 ' 



if n/2 < k <n. 



Si . V n-[n/2] +V [n/2] V k _ (S n - [n/2] +S[ n /2] ~Sk ) 2 

k(k-l) k 2 (k-l) ~*~ (n-fc)(n-fc-l) 



>^ 



^[n/2] + Ki-[n/2] Ki-fc _ (£[n/2]+£n-[Ti/2]-'S>i-fc) 



fc(fc-l) 



fc 2 (fc-l) 



(n-fc) 2 (n-fc-l) ' 
+ 



if 2 < k < n/2; 



V 2 k 

n — k 



S 2 



(n-k)(n-k-l) (n-k) 2 (n-k-l) 1 

\in/2<k<n-2. 



Clearly, with {Tfc in ,2 < k < n — 2} as in (1.10), we have 

{T kn ,2 < k < n-2} = \J^,2 < k < n - 2} for each n > 4, 



where, and throughout, = stands for equality in distribution. 



Lemma 2.1. As n — > oo, we have 

KVn) - Kj]n/{loglogn) 5 ) 
KVn) 

Proof. Since 



o(l/ log log n). (2.5) 



1 > — — > exp ^ - C / — : du \ 

> exp { - C r^ [, 

1 Vn/(}og log n) 5 iQ g %/(log log n) s J 

and ?7 n is a regularly varying function with index 1/2, for any e > 0, we have ??ri /?7n/ (log log n) 5 < 
(loglogn) 5 / 2+£ for sufficiently large n, and log J7«/(i g log n) 5 ~ (1/2) log re as n — > 00. Hence 



<-{Vn) 'Wn/^loglogn) 



o(l/ log log re). □ 



K^n) 
Lemma 2.2. As n — > 00, we have 

T,7=i(\Zj\ + E\Zj\) Pn 

— — = ► 0. 

Sn/Vloglogn 

Proof. Let Tj = 7/j(loglogj) 3 and Z? = Xjl(r]j < |Xj| < Tj). From the proof of Lemma 2 
in Csorgo et al. (2003), we have P(Zj / Z^,i.o.) = 0. Hence, by Chebyshev's inequality, 
in order to prove Lemma 2.2, we only need to prove that, as n — > 00, 

n 

J2 E \ Z j\ = o(B n /y/loglogn), (2.6) 

i=i 

n 

Y,EZf = o{Bl/\og\ogn), (2.7) 

i=i 

n 

^E\Xj\I{\Xj\ > tj) = o{B n /yJ\og log n). (2.8) 

i=i 

We only prove (2.6) and (2.8), for the proof of (2.7) is similar to that of (2.6). Since t] n is 
a regularly varying function with index 1/2, we have that for sufficiently large n, 

Vn/(\oglogn) lfi ^ E^Ogn) < 7? n /(loglogn) 9 - 



Also, similarly, by the fact that y/jQoglogj) 2 /-\/l(r]j) is a regularly varying function with 
index 1/2, we have that for sufficiently large re, 

j VJOoglogj) 2 ^ V™ 

max — = max ■ < 



l<j<n/(loglogre) 9 T)j l<j<n/{\og\ognf \fl{r)j) ^l(r] n )(loglognf 



Hence, by using the same method as that in the proof of Lemma 2.1, we have 

n n/(loglogn) 16 

^E\Z*\ < Y^ ElX^Ifa < \Xi\ < ?? n /(loglogn)9) 

i=i 3=1 

+ nE\Xx\I(r] n /(i og i ogn y6 < \Xi\ < ?? n (loglog?i) 3 ) 

n/ (log log n) 9 

< J2 JE\X 1 \I{r 1 j<\X 1 \<r }j+l ) 

3=1 

n(l{r] n {loglogn) 3 ) - l(v n /(io S io S n)™)) 

Vn/^oglogn) 16 

= o(B n / (loglogn)), n-^oo. 

Thus (2.6) is proved. 

Next, we prove (2.8). By the fact that i£|X|I(|.X~| > x) = o(l)l(x)/x as x — > oo, 

n n U \ n 1 

E e\xm\ x 3\ > Td = o(i) e ^ < °(i)'(t») e 7- 

j=l j=\ 1 j=l ■? 

Since 1/V n is a regularly varying function with index —1/2, by Tauberian theorem (see, 
for instance, Theorem 5 in Feller (1971), page 447), we have Y^j=i 7~ ~ 2n/r n as n — > oo. 
Hence, as n — > oo, 

J2E\XM\ X 3\ > Tj) = o(l)^^ = o(l)5 n /(loglogn). 

j=i Tn 

Thus (2.8) is proved and the proof of Lemma (2.2) is complete. □ 
Lemma 2.3. For all t G R, we have 

lim P(a{n) max St JB k n <t + bin)) = exp(-e~*), (2.9) 

n-+oo \ l<k<n ' ' J 

and 

lim P(a(n) max \St n \/B k n <t + bin)) = exp(-2e~ f ). (2.10) 

n->oo V l<fc<n ' / 

Proof. We only prove (2.9), since the proof of (2.10) is similar. Since l(x 2 ) < 2 Co l(x), by 
(42) in Csorgo et al. (2003), there exist two independent Wiener processes W^ 1 ' and W^ 2 ' 
such that, as n — > oo, 

S* n - WW(BI) = o(B n / Vloglogn) a.s. (2.11) 

and 

S* n - W^(B 2 n ) = o(B n / Vloglogn) a.s. (2.12) 

10 



Define K n = expjlog ' n} and 



W(n,t) 



n -V2(^(i)( nt ) _ t(W<V(n/2) + W^in/2))), 



0<t< 1/2, 



n 



-i/2(_ W r(2)( n _ nt ) + ( X _ t )(^(i)(„/2) + T^( 2 )(n/2))), 1/2 < t < 1. 



Computing its covariance function, one concludes that W(n, t) is a Brownian bridge in 
< t < 1 for each n > 1. Now, as n — )• oo, we have 



v/log log n max 

K n <k<n/2 



S tn BlW(BlBl/Bl) 



Bk ' n \lBl{Bl - Bl) 



(2.13) 



To prove (2.13), we notice that for k < n/2 
a* n 



k (n-k)\ bk ~n [bn -^ +b ^ 



Hence, for k < n/2, 



5 



fc,n 



B 2 k {Bl-Bl) 



'fcV n 
+ 



nB n 



<\W{BlB 2 k /B 2 n 
k(n — k) 



nBr, 



B 



k(n - k)B k . 



nB n 



k(n - k)B k>n 
St n -W(B 2 n ,B 2 k /B 2 n ) 



Bl{Bl-Bl) 



:= Li{k,n) + L 2 (k,n). 
First, we estimate Li(k,n). We have 



(2.14) 



k 2 {n-k?Bl n B&Bl-Bl) _ ( Bl ky k 2 (B 2 n - B 2 n/2] - B 



n 2 Bl 



'n-\nj1\> 



Bi \Bl n) n*Bl 



Note that (k/n) 5 ^ 8 < B k /B n < (k/n) 3 / 8 holds for all K n < k < n and sufficiently large n 
by the fact that B n is a regularly varying function with index 1/2. Then 



max — | — | 

K n <k<n/(\oz\ogn)S B? \B 2 n 



(B k Blk 2 

< 2 max — + -^ 

K n <k<n/ (loglogn)5 V B n B£n 2 

< 4(loglogn)" 5/8 . 



Also, by Lemma 2.1, 

Bl(B\ ky 

n/(loglogn) 5 <fc<n/2 B'l \B 2 Tl) n/(loglogn) 5 <fc<n./2 n l B'l 



max 



k 2 B 3 n (l(r] n ) ~ l(Vn/ (log log ny>)f 



l{Vn 



Hence, as n — > oo, 



o(l/\/loglog?i), n — > oo. 



,— Bl(B\ fc\2 

Vloglogn max — ^ — § ->■ 0. 

K n <k<n/2 Bf,\B 2 n) 



(2.15) 
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Again by Lemma 2.1, 



\/log log n max 

K n <k<n/2 B£ 

as n — > oo. Thus, 



Bl ^Bl-B U -Bl__ hd ^^_ 



n 2 Bl 



n 



KVn) ~ l(r] [n/2 ]) 

KVn) 



0. 



A/loglo 



g n max 



Blk\n-k?Bl n B 2 (B 2 -B 2 ) 



K n '<k<n/2 Bf 



n 2 Bl 



B 4 



0, n^oo. (2.16) 



This implies that for large n and all K n < k < n/2, 



k\n-kYBl n Bl{Bl-Bl) 



n 2 Bl 



B 4 



IB* 1 BZ(B*-B*) B n B [n/i 
~ 4 Bl ~ 4 Bi Bl-Bl 



n/2] 



< 



I B&BI-Bp 
2 B 4 



Hence, for large n and all K n < k < n/2, 
(1/2)^ 



< 



Bl(Bl-Bl) Kn~k)B k>r 



< 



2Bi 



BliBl-Bl) 



(2.17) 



Noting that |l/-y/»— l/y/y\ < \x — y\/{x.Jy) for all x,y > 0, it follows from (2.16) and 
(2.17) that 



V log log n max 

K n <k<n/2 



nB n 



Bl 



k(n-k)B k , n l B 2 k{B 2 n _ B 2 k) 



< \/2 log log n max 

_K" n <fc<n/2 



k\n-kYB^ n Bl{Bl-Bl) 



n 



2 Bl 



B A 



Bl(B*-B*h-*/2 



< 4\/loglogn max 

K n <k<n/2 Bl 

By properties of Brownian motion 



B 3 ] 



k\n-kYBl n B 2 (B 2 -B 2 ) 



n 



2 Bl 



B A 



B A 

J -*'n. 



0. 



(2.18) 



max \W(B 2 , B 2 k /B 2 n )\ < IB" 1 sup \W^(t)\ + B?\W<- 2 \b*/2)\ 

K n <k<n/2 0<t<B% 



2 sup \W {l \t)\ + \W {2) {\/2)\. 

0<i<l 



This together with (2.18) yields 



vlog log n max Li(k,n) — > 0, n — >• oo. 

A'„<fc<n/2 

Next, we estimate L^ik^n). By (2.11) and (2.12), 



k(n — k) 



nB r , 



St n -W{Bi,Bi/Bi) 



< 



k 



(2.19) 



nB n 
12 



\W^(B 2 j2)-W^(B 2 n/2] )\ 



+ -^-\W^\Bl/2)-W^{Bl, 



+ 



nB, 

k_Bl 
n Bl 



/2])\ 
\wW(B*/2)\ + \W®(B*/2)\ , o k (l)B k 



+ 



B n ' B n y/log log k ' 

where o k {l) — > as k — > oo. Similarly to the proof of (2.15), we have 



V log log n max — - 

K n <k<n/2 B k 



Bl k 

B 2 

■MS an 



n 



0, n — > oo. 



This, together with (2.17) and the fact that 
\W W (B 2 /2) | + \WM {Bl/2)\ 



as n — > oo, yields 



0oglo 



B r , 



nBr, 



gn max 



k_Bl 
B 2 



■/? 



K n <k<n/2 k(n — k)B k 
Similarly to the proof of Lemma 2.1, we have 

Vlog log n 



\W<U(l/2)\ + \W®(l/2)\, 



\W^{B 2 J2)\ + \W^{B 2 J2)\ 



B n 



0. 



Br, 



W^(Bl/2)-W^(Bf n/2] )\ I 0oilo^(^J^l) 1/ V (1) (l)l 



/ -— f(n/2)l( Vn )-ln/2]l( V[nm )y/2 (1) P 



oo. 



Hence, by (2.17), as n — > oo, 



ylog lo. 



gn max 



nB n 



k 



K n <k<n/2 k(n — k)B k ^ n nB, 
Similarly, as n — > oo, 



\WU(B 2 j2)-WU(Bf n/2] )\$0. 



\/log log n max 



K„<k<n/2 k(n — k)B kn nB n 
Also, by (2.17), as n — > oo, 

nB n 



\WW(B 2 n /2)-WW(B 2 n _ [nr )\$0. 



i/2]; 



yloglo 



gn max 



o k (l)B k P 



K n <k<n/2 k{n - k)B ktn B n y/log\ogk 



0. 



Hence 



Vloglogn max L,2(k,n) — > 0, n — > oo. 

X n <fc<n/2 

Now (2.13) follows from (2.14), (2.19) and (2.20). Now, similarly, as n ->■ oo, 



(2.20) 



y log log n max 

n/2<k<n— K n 



Si n B 2 n W(B 2 n ,B 2 /B 2 n ) 



B 



k . it 



Bl(Bl-B 2 ) 



0. 
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Hence, as n — > oo 
\/log lo, 



n 



S 



max 



k.n 



sup 



W(B 2 n ,t) 



K n <k<n-K n B Kn Kn <k<n-K n J(Bl/B*)(l - B%/B*) 

Next, we will show that, as n — > oo, 

W(Blt) W(B 2 n ,t) 



0. 



ylog log 



7? 



sup 



sup 






fk^^n.^!-*) ^<*=<n-^ J{Bl/Bl)(l - Bl/Bl) 



0. (2.21) 



Write 



A, 



inf 



B k~ B k~i KvkJ 



K n +l<k<n-K n B 2 



B 2 



and recall that W(B 2 , t) is a Brownian bridge in £ G [0, 1] for each n > 1. Hence, to prove 
(2.21), we only need to show that, as n — > oo, 



yioglog 



7? 



sup 



-<t,S< ,- 



sup 

\t-s\<A n 



W(t)-tW(l) W(s)-sW(l) 



y/t(T=i) y/s(l ~ S) 



0. 



where W(t) is a standard Brownian motion. This follows from results on the increments 
of a Brownian motion (see for instance Csorgo and Revesz (1981), Theorem 1.2.1) and by 
some basic calculations. We omit the details here. Hence, as n — > oo, 



Vloglog 



n 



max 



°k,n 



K n <k<n—K„ Bk n s 2 



sup 



W(Blt) 



B„ B~, 



V^t) 



o. 



(2.22) 



By using (A. 4. 30) and (A. 4. 31) in Csorgo and Horvath (1997), as n — > oo, we conclude 

(2 log log Bl)~W sup ^14 4 VW^, 

(2 log log Bl)~W sup ^4 4 VV12, 

where c^*) = exp{(log^)5/i2 }/5 2 Notice that B \jBl < c(B 2 n ) and B 2 n _ K jB 2 n > 
1 — c(B 2 ) for sufficiently large n. Hence, as n — > oo, 



W{Bl,t) ,,_ 2 , p 
sup / ^ n ; x - 6(5~) ->• -oo, 



VBl<t<BlJBl ^Jt{l-t 



a{B 2 n ) 



sup 



^_ K JBl<t<l-l/B* V*(l - *) 



"'W.') 0(^)4 -so. 



(2.23) 
(2.24) 
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By (A. 4. 29) and Theorem A. 3.1 in Csorgo and Horvath (1997), we arrive at 

lim p(a{B 2 n ) sup ^== < t + b(B 2 n )) = exp^e"*). (2.25) 

n ^°° V l/Bl<t<l-l/Bl y/t(l ~t) > 

Now, from (2.22)-(2.25) it follows that for all t £ R, 

lira p(a(B 2 n ) max S fe *„/£ M < t + &(£*)) = exp(- e -'). 

This, together with (2.28) below, implies that for all t € R, 



lim P[a{B 2 n ) max SlJB k>n < t + b{B l n )\ = exp(- e - 

Since, as n — )• oo, log log B\ = log log n + o(l), we have 
a{n) max S£ n /J3 fc „ - b(n) 

l<k<n ' 



« max S2 n /J3 fc>n - 6(J5^) + -^K^n) - b(n) 



a{B£) \ i<k<n ' / a[B~) 



= (1 + o(l)) a(^) max ■%„/£*,„ - 6(^) + o(l) 

V l<fe<n / 

which implies (2.9). Lemma 2.3 is proved. □ 

Proof of Theorem 1.2. Write i^ n = expjlog 1 ' 3 n}, and put 



K 

n 1 = ^K n <k<n/i:Y,\ Z i\ <B k /loglogky, 

i=l 
k 

n 2 = [K n <k<n/A:Y,\^\ <B k /\og\ogk}. 



Define Q' = fii U {/c : n/4 < fc < ra/2}, fi" = {/c : n - k G ft 2 } U {A; : n/2 < fc < 3n/4} and 
fi'i = {k : 2 < fe < n/4} - Oi, fi' 2 = {k : 3n/4 </c<n-2}-{A;:n-A;G Q 2 }- 

Notice that, as n — > oo, S\ nt ]/b n — > W(t) and V^/6 2 — > 1, where TV is a Brownian 
motion and 6 n is a regularly varying function with index 1/2. Hence 

min fc<n/4(^ n -[n/2] + V [l/2] ~ V k ~ (fli-[n/2] + g[n/2] ~ gfc)V(n - fc)) 

6 2 

^ ^n-[n/2] 3S 2 _ [n/2] +6(max 1 < fc < n/2 |S fc |) 2 p 

*« w« ^ 1/2 ' "^ 

Notice that by the self- normalized LIL of Griffin and Kuelbs (1989), as n — > oo, we have 

I <7 I 

1- \ D n\ .. 

lim sup — = 1 a.s. 

n->oc V21oglogn(y n 2 -52/n) 
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Consequently, 

1 \Sk\ , V21oglQgK n n r— 

= max — < — — (1 + oil)) = yl/3 + oil) a.s. 

V2 log log n 2<k<K n ry2_g2ifc\ V21oglogn 

Similarly, by (18) in Csorgo et al. (2003), we conclude 

max — < y 1/2 + o(l) a.s., n — > oo. 



V21oglogn fc> E- n a nd ken[ I (y2 _ ~S^Jk) 
Thus, by noting that -y±= < -2= + 4= holds for all o, b,c,d> 0, 

1 |<Sfc,nl 1 " |5 fc | 

max -= < max ■ 



a/2 log log n fcen; V" fc ,n ' " \/2 log log n ken[ n — k lyi _ gi m 

d^n/2]! + |£n-[n/2]|)/(W21oglogn) 



+ 



mfo y^^ + Vj2 /2] - l/ fc 2 - (5 n _ [n/2] + 5 [n/2] - 5 fc )V(n - k)/b n 



k<n/4 

<2v / 2/3 + o P (l), ra-S-oo. 



This, as n — 7- oo, implies 



and, similarly 



a(n) max — J 6(n) — > — oo, (2.26) 



a(n) max -— J 6(n) — > — oo. (2.27) 

Furthermore, similarly, by using (20) in Csorgo et al. (2003), and by the facts that, as 

n -)■ oo, S*/.B n A N(0,1) and limsup^^ S*/(2B* log log n) 1 / 2 = 1 a.s. (by (2.11)), we 
infer 

I *?* 

a(n) max — bin) — > — oo. (2.28) 

keU[uW 2 B kin 

Now, in order to prove Theorem 1.2, we only need to show that, as n — > oo, 



<->fc,n k.n 



ken' 
and 

, , Su n ^k 



p 



a(n) max -^ ^- 4- 0, (2.29) 

Vfc,n Bu, 



a(n) max 
fcen" 



'fc,n k.n 



Vk,n *5k,n 
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4 0. (2.30) 



In fact, if (2.29) and (2.30) hold true, then it follows from (2.28) and Lemma 2.3 that, 
for all t e M, 



]imP(a(n) max ^ S kjn /V kl n <t + b(n) ) = exp(-e ). 



And also by Lemma 2.3, we obtain that 

1 



max 



D k,n\ P 



a/2 log log n l<k<n B 



1, n — > oo. 



By noting that 



Vk,n < V k,n < max 



k.n 



k 



(2.31) 



(2.32) 



n — k 



r k n — k ~i 

Ifc-l'n-fc-lJ 



V 2 



and by applying (2.29), (2.30) and (2.32), we get that 



a(n) max 
ken'un" 



Vk,n Vk,r 



a{n) \S k . 

< — max 



'Knkeci'uci" Vk; 



a{n) 
< — : max 



P 



'K n fceH'un" 



0, n — >• oo. 



Sk,n Su, 



*k,n J^k,n 



\o,. 



a(n) 
H 7T ^ max 



<K„ ken'un" Bk,n 



(2.33) 



This, together with (2.26), (2.27) and (2.31), yields Theorem 1.2. 

Now we go to prove (2.29) and (2.30). We only prove (2.29), since the proof of (2.30) 
is similar. Clearly, we have 



a(n) max 

ken' 



^>k,n k,n 



Vk,n B k - 



< a(n) max 

ken' 



^k,n &k,n 



< a(n) max 
feea' 



a V 2 - B 2 



+ a(n) max 
ken' 



Sk,n S* k 



Bk„ 



V k ,n B 2 



k.n 



+ a[n) max 

ken' 



Sk,n Sin 



Bh , 



k,n 



(2.34) 



By the self-normalized LIL of Griffin and Kuelbs (1989), we get that, as n — > oo, 

k,n -. 

K n Sln/2 V 2 /k 2 + (V 2 _ [n/2] + V 2 n/2] - V 2 )/(n - k) 2 ' 
Hence, for sufficiently large n, 



a(n) max 
ken' 



q v 2 — B 2 

&k,n k.n k,; 



Vi 



k.n 



B 



k.n 



< 2a(n) max 

ken' 



Sk Vk,n B k 



Vk B 



k.n 



v n 



+2a(n)— max 

V r /oi ken' 

y n—[n/2\ 



S[ n /2] ~ 


Sk 


v l 


n 


Bl, n 


v n 






Bl 


n 



+2a(n) max — 



n-[n/2]\ 



ken' V, 



n- [n/2] 



T/2 R2 

v k,n n k,n 



B 2 

n k,n 



(2.35) 
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Since EX = and I^Xil 1 * < oo for any 1 < r < 2, it follows from the Marcinkiewicz- 
Zygmund strong law of large number (c.f. Chow and Teicher (1978), page 125) that 
S n /n l ' r — > a.s. Hence, as n — > oo, 



(loglogn)S^ 



a.s. 



Note that for ra/4 < k < n/2, 



EU( Z ] + \ EZ i\ 2 )/k 2 _ < 9 E*=i(^ + \ EZ i 



and, by Lemma 2.2, 



^/ 2 ]/(--^) 2 



B 



n/2] 



< 



En I 7 |2 

52/ log log n ~ \B n /y/\oglogn 

EU\ EY >\ 2 EU\ EZ 



TJj=i\ EZ j\ \ 2 



B 2 / log log n 52/ log log n \B n /^\og\ogn 
Now, by (40) of Csorgd et al. (2003), we have 



0, n — > 00. 



(log log n) max 



Vgn " E l,n 



B tn 



< 3 max ■ 

fcen' 



logiogfciELxC^ 2 -^/ 



*2 



loglogn|Effi (*?-£*?) I loglogn \zU n/2] (V- EY ? 

1 T-.o ~r 



B 



n/2] 



B 2 

n n~[n/2] 



[n/2] 



loglogfc ELi(^ 2 + l^f) 1 loglognn=i (^- + 1^1 
3 max J „„ h 10 



fcefii 



^ 2 



5 



n/2] 



loglognE;rj n/2l (^ 2 + l^| 2 ) ^ , (log log k)S 2 

H — T5 h 12 max 



B 2 

n n~[n/2] 



ken' 



+ 3 



(loglogn)52_ [n/2] (log log n)^ p 

~T~ 0~ 



*Bl 



0, n — > 00. 



(»/ 2 ) 5 „-[„/2] W 2 ) 5 [n/2] 

By the self-normalized LIL of Griffin and Kuelbs (1989), we conclude 

\S[n/2] — Sk\ 2max fc < n / 2 \S k \ 



(2.36) 



max 



< 



< 2 a.s, n — > 00. 



fc<n/2 T4V2 log log n V^\/21oglogn 
By the facts that V^/b^ — > 1 and V^/b^ — > 1, as n — > 00, we get 

Vn 



(2.37) 



K & n-[n/2] 62 



K 



ra- [n/2] 



KV r 



n- [n/2] & n-[n/2] 



2. 



(2.38) 
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Thus, by using (2.35)-(2.38) and applying again the self-normalized LIL of Griffin and 
Kuelbs (1989), as n — > oo, we arrive at 



a(n)max f "'" Vk ' n , Bk ' n 4 0. 



ken 1 



p 

V k,n B 2 k 



Similarly to the proof of (2.36), by using Lemma 2.2, we have 



a(n) max 
ken' 



Sk, n - sr ktn v^gio¥fcE; = i(l^l + l^ 

< Voniax 



A vw^zT=r(\ z j\ + \ezj\) vEgT5gHE"=r J (i^-i + \ EZ i\ 

+ 4 



B[ n /2] B n _[ n / 2 ] 

4o, rc-S-oo. (2.40) 

Now (2.29) follows from (2.34), (2.39) and (2.40). This also completes the proof of Theorem 
1.2. □ 
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